Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhancement] (nereids)implement showCollationCommand in nereids #43157

Merged
merged 5 commits into from
Dec 2, 2024
Merged

[Enhancement] (nereids)implement showCollationCommand in nereids #43157

merged 5 commits into from
Dec 2, 2024

Conversation

msridhar78
Copy link
Contributor

@msridhar78 msridhar78 commented Nov 3, 2024 •
edited
Loading

Issue Number: close #42748

implement showCollationCommand in nereids

mysql> show collation;
+--------------------+---------+------+---------+----------+---------+
| Collation | Charset | Id | Default | Compiled | Sortlen |
+--------------------+---------+------+---------+----------+---------+
| utf8mb4_0900_bin | utf8mb4 | 309 | Yes | Yes | 1 |
| utf8mb3_general_ci | utf8mb3 | 33 | Yes | Yes | 1 |
+--------------------+---------+------+---------+----------+---------+
2 rows in set (22.40 sec)

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41429 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6c745db865ee559454cdb0d509af01d51dacc421, data reload: false

------ Round 1 ----------------------------------
q1	17580	7453	7325	7325
q2	2050	167	156	156
q3	10639	1068	1194	1068
q4	10568	917	925	917
q5	7755	3045	3059	3045
q6	239	150	150	150
q7	1038	615	602	602
q8	9367	1996	2007	1996
q9	6571	6389	6433	6389
q10	7115	2409	2418	2409
q11	458	257	266	257
q12	415	225	213	213
q13	17771	3049	3016	3016
q14	246	212	210	210
q15	569	528	518	518
q16	662	598	584	584
q17	979	504	565	504
q18	7322	6671	6812	6671
q19	1330	1006	970	970
q20	471	185	190	185
q21	3984	3243	3330	3243
q22	1128	1001	1020	1001
Total cold run time: 108257 ms
Total hot run time: 41429 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7311	7288	7287	7287
q2	333	228	223	223
q3	3060	3018	3149	3018
q4	2114	1822	1844	1822
q5	5714	5782	5875	5782
q6	225	144	142	142
q7	2301	1819	1801	1801
q8	3443	3483	3550	3483
q9	8953	8959	8874	8874
q10	3615	3562	3541	3541
q11	603	539	518	518
q12	855	614	632	614
q13	10357	3222	3215	3215
q14	299	299	281	281
q15	571	513	508	508
q16	678	647	646	646
q17	1868	1629	1650	1629
q18	8233	7951	7669	7669
q19	1731	1587	1541	1541
q20	2102	1868	1904	1868
q21	5670	5466	5506	5466
q22	1140	1094	1040	1040
Total cold run time: 71176 ms
Total hot run time: 60968 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196417 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6c745db865ee559454cdb0d509af01d51dacc421, data reload: false

query1	1209	934	907	907
query2	6252	2167	2127	2127
query3	10804	4160	3935	3935
query4	67971	29359	23654	23654
query5	4969	446	434	434
query6	407	184	179	179
query7	5570	290	294	290
query8	314	228	226	226
query9	9069	2736	2742	2736
query10	470	272	254	254
query11	17454	15685	15708	15685
query12	159	102	102	102
query13	1495	441	419	419
query14	10268	7169	6954	6954
query15	206	176	175	175
query16	7017	456	433	433
query17	1031	557	563	557
query18	1784	297	297	297
query19	204	153	154	153
query20	124	109	109	109
query21	204	98	100	98
query22	4478	4324	4459	4324
query23	34643	34059	34397	34059
query24	5957	2740	2806	2740
query25	507	397	391	391
query26	645	158	157	157
query27	1686	280	298	280
query28	3927	2421	2392	2392
query29	680	428	423	423
query30	233	153	154	153
query31	980	799	821	799
query32	69	57	56	56
query33	419	270	268	268
query34	916	523	505	505
query35	865	732	738	732
query36	1079	950	944	944
query37	120	76	75	75
query38	4350	4272	4300	4272
query39	1483	1426	1431	1426
query40	195	102	98	98
query41	46	44	47	44
query42	112	98	103	98
query43	544	508	502	502
query44	1191	819	828	819
query45	184	169	165	165
query46	1115	683	699	683
query47	1961	1859	1877	1859
query48	429	326	349	326
query49	733	400	389	389
query50	810	404	394	394
query51	7291	7149	7072	7072
query52	101	91	93	91
query53	254	182	185	182
query54	533	410	405	405
query55	76	76	78	76
query56	257	243	262	243
query57	1327	1181	1133	1133
query58	219	210	212	210
query59	3340	3200	3030	3030
query60	281	261	261	261
query61	127	153	100	100
query62	815	663	651	651
query63	213	182	179	179
query64	1334	644	615	615
query65	3301	3217	3207	3207
query66	705	312	297	297
query67	16027	15711	15656	15656
query68	3845	592	572	572
query69	417	252	261	252
query70	1203	1197	1052	1052
query71	343	251	251	251
query72	6350	3998	4043	3998
query73	764	350	349	349
query74	10354	9010	8953	8953
query75	3410	2663	2682	2663
query76	1838	1101	994	994
query77	443	282	267	267
query78	10635	9420	9403	9403
query79	1577	583	578	578
query80	881	425	464	425
query81	511	238	239	238
query82	1300	113	115	113
query83	218	138	139	138
query84	281	69	68	68
query85	925	296	292	292
query86	338	304	299	299
query87	4874	4690	4828	4690
query88	3630	2197	2151	2151
query89	423	286	291	286
query90	1998	193	187	187
query91	134	96	102	96
query92	64	50	51	50
query93	1951	537	541	537
query94	778	293	271	271
query95	352	250	248	248
query96	615	278	288	278
query97	2879	2693	2692	2692
query98	210	205	200	200
query99	1735	1321	1330	1321
Total cold run time: 318815 ms
Total hot run time: 196417 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.19 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6c745db865ee559454cdb0d509af01d51dacc421, data reload: false

query1	0.04	0.02	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.64	0.10	0.10
query5	0.41	0.39	0.40
query6	1.19	0.65	0.65
query7	0.02	0.02	0.02
query8	0.03	0.03	0.03
query9	0.55	0.50	0.49
query10	0.55	0.54	0.57
query11	0.14	0.10	0.11
query12	0.15	0.11	0.10
query13	0.60	0.59	0.59
query14	2.83	2.73	2.71
query15	0.90	0.83	0.83
query16	0.39	0.37	0.35
query17	1.06	1.06	1.01
query18	0.21	0.20	0.20
query19	1.83	1.84	1.88
query20	0.02	0.01	0.01
query21	15.38	0.60	0.58
query22	2.17	2.78	1.95
query23	16.94	1.33	0.93
query24	2.91	0.55	1.64
query25	0.28	0.08	0.08
query26	0.47	0.13	0.14
query27	0.04	0.05	0.05
query28	10.85	1.09	1.08
query29	12.57	3.23	3.24
query30	0.24	0.06	0.06
query31	2.87	0.38	0.36
query32	3.29	0.47	0.45
query33	2.98	2.98	3.20
query34	16.81	4.46	4.51
query35	4.49	4.47	4.46
query36	0.64	0.47	0.52
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.04	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.3 s
Total hot run time: 32.19 s

@msridhar78 msridhar78 marked this pull request as draft November 4, 2024 04:40
@msridhar78 msridhar78 marked this pull request as ready for review November 4, 2024 16:37
starocean999
starocean999 reviewed Nov 15, 2024
View reviewed changes
...e-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowCollationCommand.java Outdated
/**
* Represents the command for SHOW COLLATION
*/
public class ShowCollationCommand extends Command implements NoForward {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
public class ShowCollationCommand extends Command implements NoForward {
public class ShowCollationCommand extends ShowCommand {

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done - pls review

@starocean999
Copy link
Contributor

please add test case

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40011 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf9304d78c66766469c962ecab6610a6feef1a4f, data reload: false

------ Round 1 ----------------------------------
q1	17591	7606	7368	7368
q2	2073	174	164	164
q3	10584	1101	1118	1101
q4	10526	736	842	736
q5	7605	2727	2727	2727
q6	240	150	148	148
q7	986	635	607	607
q8	9239	1826	1913	1826
q9	6494	6420	6415	6415
q10	6996	2274	2347	2274
q11	471	273	266	266
q12	416	217	224	217
q13	17770	3034	3029	3029
q14	255	216	220	216
q15	579	548	521	521
q16	668	605	575	575
q17	986	514	583	514
q18	7199	6758	6702	6702
q19	1342	951	917	917
q20	454	190	181	181
q21	4113	3256	3192	3192
q22	381	320	315	315
Total cold run time: 106968 ms
Total hot run time: 40011 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7322	7319	7290	7290
q2	323	232	233	232
q3	2962	2843	3011	2843
q4	2063	1814	1826	1814
q5	5700	5715	5671	5671
q6	241	148	146	146
q7	2288	1903	1834	1834
q8	3434	3539	3539	3539
q9	8872	8946	8969	8946
q10	3607	3604	3568	3568
q11	615	524	511	511
q12	821	628	608	608
q13	12000	3311	3330	3311
q14	316	273	295	273
q15	586	529	524	524
q16	682	687	641	641
q17	1859	1642	1600	1600
q18	8269	7890	7486	7486
q19	1710	1563	1575	1563
q20	2115	1901	1928	1901
q21	5709	5386	5508	5386
q22	649	562	573	562
Total cold run time: 72143 ms
Total hot run time: 60249 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196882 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bf9304d78c66766469c962ecab6610a6feef1a4f, data reload: false

query1	1243	958	919	919
query2	6593	2196	2130	2130
query3	10938	4132	3973	3973
query4	67883	28600	23754	23754
query5	4954	491	452	452
query6	402	190	180	180
query7	5499	306	299	299
query8	315	225	229	225
query9	8523	2698	2674	2674
query10	436	271	254	254
query11	17341	15386	15941	15386
query12	159	110	108	108
query13	1449	443	430	430
query14	10869	7665	7741	7665
query15	218	196	206	196
query16	7076	435	516	435
query17	1049	555	554	554
query18	1788	295	293	293
query19	195	152	141	141
query20	113	140	108	108
query21	205	101	103	101
query22	4687	4237	4428	4237
query23	34732	34236	34249	34236
query24	5344	2338	2404	2338
query25	475	392	372	372
query26	633	152	149	149
query27	1660	279	291	279
query28	4319	2429	2424	2424
query29	659	414	407	407
query30	220	146	146	146
query31	988	809	811	809
query32	65	56	57	56
query33	408	288	267	267
query34	914	502	509	502
query35	852	709	725	709
query36	1069	945	964	945
query37	118	77	74	74
query38	4299	4233	4179	4179
query39	1488	1449	1422	1422
query40	194	98	94	94
query41	44	43	43	43
query42	107	101	96	96
query43	539	510	504	504
query44	1148	804	815	804
query45	181	164	169	164
query46	1124	699	698	698
query47	1949	1851	1848	1848
query48	406	324	319	319
query49	705	380	379	379
query50	803	387	405	387
query51	7242	7122	7085	7085
query52	107	88	91	88
query53	258	177	178	177
query54	517	409	402	402
query55	80	77	74	74
query56	250	256	237	237
query57	1271	1190	1160	1160
query58	225	220	210	210
query59	3379	3294	3158	3158
query60	278	261	246	246
query61	122	108	106	106
query62	801	671	673	671
query63	217	184	184	184
query64	1367	668	667	667
query65	3280	3218	3249	3218
query66	755	306	301	301
query67	16045	15641	15727	15641
query68	3786	576	545	545
query69	433	258	265	258
query70	1193	1152	1090	1090
query71	345	253	254	253
query72	6288	4102	4245	4102
query73	765	352	359	352
query74	10261	9019	9130	9019
query75	3405	2699	2664	2664
query76	1985	967	1089	967
query77	455	279	273	273
query78	10664	9514	9435	9435
query79	2027	605	607	605
query80	1426	413	434	413
query81	523	245	233	233
query82	1290	122	119	119
query83	277	161	160	160
query84	281	71	69	69
query85	1027	307	300	300
query86	415	297	306	297
query87	4693	4692	4636	4636
query88	3835	2200	2156	2156
query89	424	289	291	289
query90	1985	189	187	187
query91	140	99	103	99
query92	69	49	54	49
query93	2981	536	551	536
query94	833	303	297	297
query95	351	250	247	247
query96	645	318	282	282
query97	2934	2653	2716	2653
query98	211	208	204	204
query99	1605	1305	1304	1304
Total cold run time: 321124 ms
Total hot run time: 196882 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.93 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bf9304d78c66766469c962ecab6610a6feef1a4f, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.08	0.07
query4	1.61	0.11	0.10
query5	0.45	0.42	0.43
query6	1.18	0.66	0.64
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.57	0.52	0.51
query10	0.56	0.56	0.55
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.60	0.61
query14	2.84	2.87	2.73
query15	0.91	0.84	0.83
query16	0.37	0.37	0.37
query17	1.02	1.03	1.00
query18	0.20	0.20	0.20
query19	1.88	1.89	2.01
query20	0.02	0.01	0.01
query21	15.36	0.60	0.58
query22	2.81	1.85	1.58
query23	17.03	0.87	0.98
query24	3.21	1.34	0.50
query25	0.16	0.21	0.09
query26	0.46	0.14	0.13
query27	0.04	0.05	0.04
query28	10.73	1.10	1.07
query29	12.56	3.20	3.17
query30	0.25	0.06	0.05
query31	2.88	0.38	0.38
query32	3.25	0.47	0.47
query33	2.96	3.03	3.08
query34	17.11	4.48	4.52
query35	4.51	4.48	4.50
query36	0.63	0.52	0.48
query37	0.09	0.07	0.06
query38	0.04	0.04	0.03
query39	0.04	0.03	0.02
query40	0.15	0.13	0.12
query41	0.07	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.3 s
Total hot run time: 31.93 s

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40046 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bf9304d78c66766469c962ecab6610a6feef1a4f, data reload: false

------ Round 1 ----------------------------------
q1	17596	7542	7270	7270
q2	2040	170	167	167
q3	10771	1075	1197	1075
q4	10508	771	698	698
q5	7622	2774	2694	2694
q6	240	153	145	145
q7	965	639	605	605
q8	9244	1859	1984	1859
q9	6513	6485	6531	6485
q10	7077	2296	2337	2296
q11	470	268	254	254
q12	411	220	216	216
q13	17762	3033	3038	3033
q14	248	236	225	225
q15	574	532	519	519
q16	685	609	602	602
q17	998	611	589	589
q18	7335	6645	6694	6645
q19	1338	1011	1042	1011
q20	477	182	183	182
q21	4060	3162	3319	3162
q22	395	324	314	314
Total cold run time: 107329 ms
Total hot run time: 40046 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7272	7265	7334	7265
q2	327	233	233	233
q3	2967	2866	2926	2866
q4	2064	1896	1887	1887
q5	5659	5709	5685	5685
q6	230	142	137	137
q7	2224	1844	1829	1829
q8	3433	3579	3570	3570
q9	8857	9007	8979	8979
q10	3601	3584	3576	3576
q11	613	506	504	504
q12	844	641	632	632
q13	11715	3250	3262	3250
q14	316	272	277	272
q15	567	510	530	510
q16	687	618	638	618
q17	1857	1669	1606	1606
q18	8437	7822	7570	7570
q19	1761	1452	1535	1452
q20	2148	1924	1872	1872
q21	5639	5503	5460	5460
q22	646	568	590	568
Total cold run time: 71864 ms
Total hot run time: 60341 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198045 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bf9304d78c66766469c962ecab6610a6feef1a4f, data reload: false

query1	1245	953	955	953
query2	6233	2153	2107	2107
query3	10819	4130	3906	3906
query4	67621	29619	23458	23458
query5	5035	466	446	446
query6	437	184	187	184
query7	5635	314	305	305
query8	327	235	242	235
query9	9045	2679	2676	2676
query10	458	253	258	253
query11	17625	15382	15843	15382
query12	164	111	105	105
query13	1604	438	436	436
query14	10032	7742	7243	7243
query15	225	180	187	180
query16	7365	500	457	457
query17	1073	576	575	575
query18	1983	297	287	287
query19	196	163	160	160
query20	128	116	118	116
query21	203	106	104	104
query22	4916	4639	4677	4639
query23	36003	35081	34704	34704
query24	5445	2575	2490	2490
query25	500	405	430	405
query26	666	156	152	152
query27	1810	283	291	283
query28	4445	2495	2481	2481
query29	679	435	457	435
query30	215	160	152	152
query31	1013	803	842	803
query32	64	53	58	53
query33	416	292	272	272
query34	948	521	520	520
query35	844	766	743	743
query36	1088	961	983	961
query37	123	77	83	77
query38	4536	4482	4393	4393
query39	1517	1482	1495	1482
query40	198	106	104	104
query41	46	46	42	42
query42	116	105	107	105
query43	544	511	514	511
query44	1183	835	843	835
query45	188	178	167	167
query46	1182	715	713	713
query47	1995	1950	1950	1950
query48	425	326	335	326
query49	745	386	404	386
query50	859	396	419	396
query51	7317	7363	7234	7234
query52	100	88	86	86
query53	266	184	181	181
query54	503	421	389	389
query55	78	76	75	75
query56	256	234	229	229
query57	1289	1164	1169	1164
query58	231	247	222	222
query59	3347	3091	2924	2924
query60	274	260	249	249
query61	119	123	123	123
query62	849	693	678	678
query63	214	190	202	190
query64	1363	682	647	647
query65	3331	3220	3220	3220
query66	630	307	304	304
query67	15995	15914	15734	15734
query68	4045	561	562	561
query69	416	261	259	259
query70	1191	1107	1160	1107
query71	317	257	262	257
query72	6272	4049	4105	4049
query73	777	361	365	361
query74	10083	9092	8971	8971
query75	3422	2686	2703	2686
query76	1798	1101	1091	1091
query77	492	283	266	266
query78	10559	9464	9422	9422
query79	1653	599	607	599
query80	896	443	433	433
query81	503	225	229	225
query82	1311	126	118	118
query83	250	149	151	149
query84	282	80	76	76
query85	920	309	307	307
query86	342	311	289	289
query87	4699	4677	4567	4567
query88	3772	2319	2237	2237
query89	419	296	298	296
query90	1903	194	190	190
query91	142	107	107	107
query92	69	50	51	50
query93	1946	543	544	543
query94	739	302	275	275
query95	356	251	256	251
query96	642	275	277	275
query97	2901	2725	2717	2717
query98	213	217	224	217
query99	1896	1297	1312	1297
Total cold run time: 321550 ms
Total hot run time: 198045 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.35 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bf9304d78c66766469c962ecab6610a6feef1a4f, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.06
query4	1.62	0.10	0.10
query5	0.44	0.42	0.42
query6	1.16	0.67	0.66
query7	0.01	0.01	0.02
query8	0.04	0.03	0.03
query9	0.57	0.54	0.49
query10	0.55	0.57	0.56
query11	0.14	0.10	0.11
query12	0.14	0.12	0.10
query13	0.62	0.60	0.62
query14	2.83	2.77	2.78
query15	0.91	0.82	0.82
query16	0.38	0.41	0.40
query17	1.08	1.06	1.05
query18	0.23	0.22	0.21
query19	1.98	1.80	2.00
query20	0.02	0.01	0.01
query21	15.36	0.58	0.59
query22	2.94	2.18	1.52
query23	16.97	1.01	0.79
query24	3.18	0.96	1.49
query25	0.34	0.06	0.11
query26	0.46	0.14	0.13
query27	0.04	0.04	0.03
query28	10.40	1.12	1.07
query29	12.54	3.38	3.30
query30	0.25	0.08	0.07
query31	2.84	0.38	0.37
query32	3.28	0.47	0.47
query33	2.99	3.04	3.02
query34	16.96	4.49	4.47
query35	4.53	4.46	4.51
query36	0.66	0.51	0.48
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.13	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.28 s
Total hot run time: 32.35 s

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39800 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1479c870f6df8b0aad06f3e7c7cf95fa660cb033, data reload: false

------ Round 1 ----------------------------------
q1	17584	7422	7255	7255
q2	2043	189	165	165
q3	10593	1070	1235	1070
q4	10462	786	690	690
q5	7629	2769	2624	2624
q6	237	150	146	146
q7	969	619	611	611
q8	9255	1860	1907	1860
q9	6558	6408	6414	6408
q10	7048	2355	2353	2353
q11	464	273	255	255
q12	408	219	218	218
q13	17764	3053	2987	2987
q14	246	209	211	209
q15	591	550	520	520
q16	662	583	584	583
q17	980	547	551	547
q18	7438	6687	6726	6687
q19	1344	1054	978	978
q20	457	183	191	183
q21	3944	3201	3142	3142
q22	382	316	309	309
Total cold run time: 107058 ms
Total hot run time: 39800 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7301	7246	7250	7246
q2	324	235	233	233
q3	2877	2840	3007	2840
q4	2038	1763	1787	1763
q5	5714	5699	5624	5624
q6	230	147	144	144
q7	2308	1846	1828	1828
q8	3416	3573	3502	3502
q9	8818	8889	8957	8889
q10	3617	3583	3564	3564
q11	604	509	515	509
q12	839	597	618	597
q13	12441	3298	3246	3246
q14	300	283	291	283
q15	580	521	517	517
q16	714	631	638	631
q17	1852	1644	1616	1616
q18	8420	7645	7643	7643
q19	1864	1508	1596	1508
q20	2118	1882	1909	1882
q21	5561	5317	5390	5317
q22	634	556	552	552
Total cold run time: 72570 ms
Total hot run time: 59934 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197746 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1479c870f6df8b0aad06f3e7c7cf95fa660cb033, data reload: false

query1	1275	1041	974	974
query2	6270	2059	2014	2014
query3	10948	4281	4100	4100
query4	67608	28314	23771	23771
query5	4903	493	457	457
query6	412	187	184	184
query7	5633	313	296	296
query8	314	236	235	235
query9	8986	2769	2757	2757
query10	439	263	252	252
query11	17551	15408	15828	15408
query12	163	98	108	98
query13	1552	440	398	398
query14	10851	7225	6926	6926
query15	218	187	183	183
query16	7116	437	475	437
query17	1404	563	572	563
query18	1826	302	307	302
query19	211	157	162	157
query20	120	113	119	113
query21	224	107	108	107
query22	4804	4581	4464	4464
query23	35215	34231	34623	34231
query24	5429	2636	2561	2561
query25	511	392	394	392
query26	639	154	153	153
query27	1868	287	291	287
query28	4839	2505	2501	2501
query29	665	429	440	429
query30	212	152	149	149
query31	1024	819	870	819
query32	64	56	54	54
query33	405	306	341	306
query34	930	529	559	529
query35	901	759	720	720
query36	1123	993	968	968
query37	123	71	76	71
query38	4672	4469	4475	4469
query39	1553	1485	1495	1485
query40	204	101	105	101
query41	48	44	44	44
query42	121	99	104	99
query43	572	498	513	498
query44	1170	821	820	820
query45	188	177	165	165
query46	1150	721	720	720
query47	2056	1931	1958	1931
query48	446	335	335	335
query49	718	400	396	396
query50	845	412	434	412
query51	7345	7098	7139	7098
query52	111	93	88	88
query53	257	185	183	183
query54	521	393	397	393
query55	76	77	79	77
query56	250	246	241	241
query57	1273	1251	1176	1176
query58	212	217	237	217
query59	3241	3092	2996	2996
query60	270	240	258	240
query61	111	108	107	107
query62	781	669	673	669
query63	217	196	193	193
query64	1376	671	638	638
query65	3289	3225	3209	3209
query66	686	301	301	301
query67	16094	15689	15679	15679
query68	4013	588	558	558
query69	423	257	261	257
query70	1253	1161	1146	1146
query71	366	256	250	250
query72	6421	4071	4091	4071
query73	769	356	359	356
query74	10144	9179	9123	9123
query75	3411	2693	2676	2676
query76	1820	1127	1160	1127
query77	476	273	278	273
query78	10454	9505	9355	9355
query79	1622	601	598	598
query80	883	433	436	433
query81	512	226	226	226
query82	1287	124	121	121
query83	216	143	158	143
query84	283	73	68	68
query85	897	322	331	322
query86	345	284	293	284
query87	4681	4594	4777	4594
query88	3865	2244	2217	2217
query89	428	298	289	289
query90	2008	192	191	191
query91	140	105	110	105
query92	65	55	51	51
query93	2031	535	550	535
query94	775	307	298	298
query95	353	255	253	253
query96	621	282	274	274
query97	2919	2687	2686	2686
query98	224	193	193	193
query99	1609	1333	1327	1327
Total cold run time: 321943 ms
Total hot run time: 197746 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.48 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1479c870f6df8b0aad06f3e7c7cf95fa660cb033, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.08	0.07
query4	1.65	0.10	0.10
query5	0.42	0.43	0.39
query6	1.16	0.68	0.68
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.57	0.51	0.50
query10	0.54	0.55	0.57
query11	0.15	0.11	0.11
query12	0.13	0.12	0.11
query13	0.61	0.60	0.60
query14	2.85	2.88	2.82
query15	0.90	0.83	0.83
query16	0.39	0.38	0.37
query17	1.04	1.05	1.05
query18	0.22	0.21	0.21
query19	1.93	1.80	2.00
query20	0.01	0.01	0.02
query21	15.36	0.63	0.61
query22	2.67	2.70	2.13
query23	17.02	0.83	0.92
query24	3.22	1.63	1.27
query25	0.31	0.10	0.19
query26	0.47	0.14	0.14
query27	0.04	0.05	0.04
query28	9.70	1.09	1.06
query29	12.56	3.23	3.23
query30	0.25	0.06	0.06
query31	2.91	0.40	0.38
query32	3.25	0.47	0.47
query33	2.97	3.09	3.09
query34	17.03	4.48	4.48
query35	4.54	4.50	4.48
query36	0.67	0.49	0.49
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.14
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.41 s
Total hot run time: 33.48 s

@msridhar78
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39527 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b5e0a29fddab0f74d1988578119e29fc1e3e7961, data reload: false

------ Round 1 ----------------------------------
q1	17594	7527	7260	7260
q2	2046	186	169	169
q3	10631	1058	1148	1058
q4	10535	739	692	692
q5	7603	2704	2765	2704
q6	242	147	148	147
q7	981	621	602	602
q8	9218	1832	1921	1832
q9	6406	6397	6383	6383
q10	7046	2272	2320	2272
q11	470	245	257	245
q12	426	222	222	222
q13	17786	3011	3018	3011
q14	251	206	209	206
q15	573	531	520	520
q16	651	575	577	575
q17	966	571	512	512
q18	7226	6751	6678	6678
q19	1342	1031	855	855
q20	458	187	183	183
q21	3987	3100	3106	3100
q22	390	314	301	301
Total cold run time: 106828 ms
Total hot run time: 39527 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7246	7260	7229	7229
q2	332	227	226	226
q3	2885	2778	2886	2778
q4	2006	1804	1763	1763
q5	5735	5659	5663	5659
q6	224	142	143	142
q7	2234	1798	1806	1798
q8	3381	3587	3540	3540
q9	8902	8816	8852	8816
q10	3620	3572	3514	3514
q11	602	504	537	504
q12	823	611	608	608
q13	10152	3326	3260	3260
q14	311	283	269	269
q15	573	527	513	513
q16	703	645	654	645
q17	1855	1662	1625	1625
q18	8353	7796	7776	7776
q19	1723	1544	1597	1544
q20	2123	1908	1890	1890
q21	5526	5355	5239	5239
q22	657	593	589	589
Total cold run time: 69966 ms
Total hot run time: 59927 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197102 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b5e0a29fddab0f74d1988578119e29fc1e3e7961, data reload: false

query1	1284	957	1002	957
query2	6234	2096	2036	2036
query3	10930	4066	4074	4066
query4	67454	26913	23535	23535
query5	4970	447	470	447
query6	402	187	184	184
query7	5542	299	299	299
query8	340	233	253	233
query9	8566	2720	2730	2720
query10	423	249	250	249
query11	17181	15302	15859	15302
query12	153	102	105	102
query13	1470	441	442	441
query14	10519	7269	6921	6921
query15	210	199	194	194
query16	7488	518	473	473
query17	1143	592	586	586
query18	1936	339	323	323
query19	209	163	165	163
query20	119	121	114	114
query21	228	102	109	102
query22	4676	4332	4587	4332
query23	35126	34627	34658	34627
query24	5531	2507	2529	2507
query25	501	395	396	395
query26	657	156	152	152
query27	1888	289	300	289
query28	4622	2510	2499	2499
query29	675	438	422	422
query30	219	150	157	150
query31	992	826	821	821
query32	71	54	60	54
query33	407	287	291	287
query34	927	525	509	509
query35	877	751	765	751
query36	1093	955	950	950
query37	125	83	76	76
query38	4376	4434	4522	4434
query39	1526	1489	1451	1451
query40	204	99	101	99
query41	47	44	45	44
query42	114	104	103	103
query43	536	504	498	498
query44	1211	830	843	830
query45	192	171	165	165
query46	1136	716	711	711
query47	2031	1944	1946	1944
query48	434	327	330	327
query49	717	418	395	395
query50	832	399	394	394
query51	7449	7241	7061	7061
query52	101	86	87	86
query53	250	176	178	176
query54	510	397	384	384
query55	83	77	78	77
query56	261	234	233	233
query57	1315	1194	1156	1156
query58	239	223	209	209
query59	3234	3219	2918	2918
query60	273	254	250	250
query61	116	105	110	105
query62	814	665	672	665
query63	216	185	191	185
query64	1417	679	632	632
query65	3305	3218	3195	3195
query66	683	306	300	300
query67	16077	15858	15696	15696
query68	4017	571	550	550
query69	422	264	254	254
query70	1248	1149	1142	1142
query71	316	256	247	247
query72	6422	4144	4025	4025
query73	762	351	434	351
query74	9412	9085	9090	9085
query75	3337	2671	2672	2671
query76	1900	1040	1107	1040
query77	484	266	282	266
query78	10568	9535	9402	9402
query79	2101	591	602	591
query80	1387	421	439	421
query81	517	239	227	227
query82	1294	118	126	118
query83	272	149	151	149
query84	283	74	70	70
query85	1022	338	309	309
query86	416	307	269	269
query87	4741	4711	4611	4611
query88	3650	2227	2192	2192
query89	422	309	286	286
query90	1967	187	192	187
query91	131	101	103	101
query92	65	49	52	49
query93	2912	547	545	545
query94	809	307	287	287
query95	349	242	249	242
query96	635	272	292	272
query97	2845	2684	2661	2661
query98	220	193	190	190
query99	1636	1320	1301	1301
Total cold run time: 321449 ms
Total hot run time: 197102 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.95 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b5e0a29fddab0f74d1988578119e29fc1e3e7961, data reload: false

query1	0.03	0.04	0.03
query2	0.06	0.04	0.03
query3	0.23	0.08	0.06
query4	1.63	0.10	0.11
query5	0.44	0.41	0.42
query6	1.15	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.56	0.53	0.49
query10	0.56	0.56	0.56
query11	0.14	0.10	0.11
query12	0.15	0.11	0.11
query13	0.61	0.59	0.61
query14	2.74	2.76	2.87
query15	0.91	0.84	0.83
query16	0.39	0.38	0.38
query17	1.04	1.10	1.07
query18	0.22	0.20	0.21
query19	1.88	1.76	1.96
query20	0.01	0.01	0.01
query21	15.35	0.58	0.59
query22	2.80	2.08	1.94
query23	16.98	1.16	0.89
query24	3.18	1.05	1.24
query25	0.24	0.06	0.07
query26	0.60	0.13	0.13
query27	0.05	0.05	0.04
query28	10.49	1.10	1.08
query29	12.52	3.24	3.22
query30	0.24	0.06	0.07
query31	2.88	0.38	0.37
query32	3.30	0.46	0.46
query33	2.99	3.15	3.13
query34	17.01	4.44	4.45
query35	4.50	4.59	4.53
query36	0.65	0.49	0.49
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.02	0.03
query40	0.16	0.11	0.13
query41	0.07	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 107.06 s
Total hot run time: 32.95 s

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 2, 2024

PR approved by anyone and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 2, 2024

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 2, 2024
@starocean999 starocean999 merged commit b8555c4 into apache:master Dec 2, 2024
24 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@LiBinfeng-01 LiBinfeng-01 LiBinfeng-01 approved these changes

@starocean999 starocean999 starocean999 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Enhancement] (nereids)implement showCollationCommand in nereids
4 participants
@msridhar78 @doris-robot @starocean999 @LiBinfeng-01